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1 | INTRODUCTION 
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Abstract 

In recent years, marketers have placed increased reliance upon artificial intelligence 
(Al) and, subsequently, the use of virtual agents in customer service contexts is on 
the rise. Despite such service digitalization, service can still fail. While there is an 
increasing literature on the effect of virtual agents in service settings, questions 
remain as to how customers react to service failure that results from interactions 
with virtual service agents. To this end, we deconstruct the effect of virtual agent 
service failure across two studies: one involving a process service failure and another 
involving an outcome service failure. We specifically manipulate the type of service 
agent that causes the service failure (human vs. virtual agent) and the magnitude of 
the failure (small vs. large). Results show that firms can leverage virtual service 
agents to mitigate or buffer the negative effects of service failure. From a managerial 
perspective, our findings suggest that firms could engage virtual service agents in 
situations where there may be a risk of outcome service failure—particularly in 
settings where relatively large magnitude failures may be experienced. In such a 
setting, we find that virtual service agents can mitigate the negative effects of 
service failure, more so than when the failure results from an interaction with a 


human service agent. 
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artificial intelligence (Al), human-machine interaction, service failure, service robots, virtual 
service agents 


(Bonetti et al., 2022; Campbell et al., 2020; Lim et al., 2022) and 


beyond to even manipulate reality (Campbell, Plangger, Sands, & 


Frontline service employees, or service agents, are a critical factor in 
determining service success (Wirtz & Lovelock, 2016; Wirtz et al., 
2018). By personally engaging with customers in shopping experi- 
ences, service agents influence a significant proportion of in-store 
purchase decisions (Chung et al., 2020; Kim & Ko, 2012). Just as 
technology has evolved, so too have service interactions, with 


today's artificial intelligence (Al) transforming service possibilities 


Kietzmann, 2022; Campbell, Plangger, Sands, Kietzmann, et al., 2022). 
As a result, there has been an increase in the deployment of virtual 
service agents, sometimes called intelligent virtual agents or chatbots, 
which are software programs that use scripted rules and Al to 
provide automated service or guidance to customers (Botelho, 2020). 
In parallel, customers have been spending an increasing amount of 


time in digital environments. While many brands have begun 
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migrating toward digital service solutions, virtual service agents are 


anen 


now starting to replace (or complement) human agents in the 
provision of customer service on websites, social media, and 
messaging services (Chung et al., 2020; Crolic et al., 2021; Sands, 
Ferraro, et al., 2022). In fact, it is expected that many service 
interactions will eventually be conducted through augmented or 
virtual service interactions, replacing traditional forms of interaction 
(Kharod, 2021). In fact, immersive technology environments, such as 
the metaverse, will only amplify this trend (Kozinets, 2022). 

Despite business' uptake of this technology, customer responses 
to virtual service agents have received somewhat limited attention in 
the marketing and services literature. While some recent articles 
provide important conceptual contributions (e.g., Grewal & 
Roggeveen, 2020; Van Doorn et al., 2017; Wirtz et al., 2018), 
empirical work is relatively scarce (c.f., Mende et al., 2019; Söderlund 
& Oikarinen, 2021; Yam et al., 2020). Several recent studies have 
investigated the role of service robots in service failure situations 
(e.g., Choi et al., 2020), finding that the more “human-like” robots 
receive better reactions. However, unlike robots, virtual service 
agents are generally not “seen”; rather they are digital entities, like 
chatbots, that communicate with customers. With this study, we add 
to the emerging stream of research investigating consumer reactions 
to virtual service agents' service failure. This stream of research is 
important given that customer rage and complaints can result from 
negative digital service encounters (Sanders, 2017). 

This study investigates how customers respond to different 
types of service failure resulting from an interaction with a virtual 
service agent, in comparison with a human service agent. Because 
empirical studies that explore the role of virtual service agents in 
shaping customer experience have emerged only recently (c.f., 
Söderlund & Oikarinen, 2021; Yam et al., 2020), we offer two main 
contributions based on our theoretical development and experi- 
mental findings. First, we contribute to the literature on virtual- 
human interactions and offer a better understanding of the way(s) 
that people respond to virtual entities. Specifically, we extend the 
knowledge about embodied virtual agents (i.e., having a virtual body 
or face) with which a physical interaction is possible (i.e., Choi et al., 
2020) to include disembodied virtual agents (i.e., that cannot be 
directly seen) (Araujo, 2018). Second, we contribute to the current 
virtual agent service failure literature. In contrast to recent findings 
that customers tend to react more negatively to virtual service agents 
(e.g., Belanche et al., 2020), we take a more nuanced perspective to 
illustrate how these reactions are also dependent on the nature of a 
service failure. In fact, we find that in some cases, virtual service 
agents can act as a buffer against the negative effect of service 
failure. Further, we show distinct differences in customer responses 
to service failures of varying magnitude (smaller vs. larger) resulting 
from a service encounter with a virtual service agent. 

The following section provides a review of research on virtual 
service agents and gives a detailed description of service failures in 
general. We then present two experimental studies that vary the type 
of service failure: a process failure (Study 1) and outcome failure 


(Study 2). Finally, we provide a general discussion of our findings and 


their implications for the broader theoretical and managerial 


contexts. 


2 | BACKGROUND 
2.1 | The evolution of service interactions 


Interactions with service agents are important in the management of 
firm-customeinteractions, having been viewed as one of an organiza- 
tion's most important assets in serving and conversing with 
customers (Wirtz & Jerger, 2017). Traditionally, firms seek to 
leverage service agents' expertise, problem-solving capacity, and 
creativity to help manage customer relationships (Martinaityte et al., 
2019; Ulaga & Reinartz, 2011). However, with the evolution of digital 
technologies, there have been fundamental changes in the way that 
firms and customers interact (Larivière et al., 2017; Wirtz 
et al., 2018). 

One such change is a shift from face-to-face service encounters 
to virtual interactions. Indeed, today a variety of virtual interactions 
can occur via social media, online chat, and virtual service agents 
(Gnewuch et al., 2017; Köhler et al., 2011; Söderlund & Oikarinen, 
2021). Typically, a virtual service agent utilizes Al to simulate human 
behavior when interacting with customers (Cassell et al., 2000). The 
deployment of virtual assistants for customer service can bring 
several benefits to firms. For instance, beyond the initial develop- 
ment cost, virtual assistants have close to zero incremental cost. They 
also deliver predictable and consistent service interactions with 
minimal error and high reliability (Huang & Rust, 2018). This shift 
toward virtual service agents follows the trend whereby robots are 
replacing humans in jobs involving analytical, intuitive, and empa- 
thetic skills in addition to mechanical jobs (Huang & Rust, 2018). 
Hence, frontline service automation in the retail and service 
industries is an emergent field of study (Grewal et al., 2017). 

The study of virtual service agents has received increased 
attention in terms of both theory and practice (Chung et al., 2020), 
resulting in several streams of research. Table 1 presents a summary 
of existing work on virtual service agents across three common 
themes identified in the literature—virtual agent design elements, 
consumer reactions to virtual agents, and consumer responses to 
virtual agent service failures. As indicated by the table, our work is 
situated within the broad domain of consumer responses to virtual 
agent service failures. 

One stream of current research relates to the design elements of 
virtual agents (i.e. Adam et al., 2021; Gnewuch et al., 2017; 
Söderlund & Oikarinen, 2021; Söderlund et al., 2022). In this regard, 
prior research shows that virtual service agents—as well as other 
robots—can be designed in ways that positively influence consumer 
perceptions (Söderlund et al., 2021) and reactions (Adam et al., 2021). 
For instance, anthropomorphic design elements can be applied to a 
virtual service agent to create a sense of social presence by 
conveying the characteristics of human-human communication 
(Adam et al., 2021; Letheren et al., 2021; Söderlund & Oikarinen, 
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TABLE 1 
Research stream 


Design elements 


Consumer 
reactions 


Authors 
Adam et al. (2021) 


Araujo (2018) 


Gnewuch et al. (2017) 


Söderlund and 
Oikarinen (2021) 


Söderlund et al. (2021) 


Söderlund et al. (2022) 


Chung et al. (2020) 


Kohler et al. (2011) 


Kull et al. (2021) 


Pitardi and Marriott (2021) 


Robinson et al. (2020) 


Sandbank et al. (2017) 


Sands et al. (2021) 


Tran et al. (2021) 


Tsai et al. (2021) 


Verhagen et al. (2014) 


Ling et al. (2021) 


Melian-Gonzalez 
et al. (2021) 


Virtual service agent literature: Positioning table 


Method 


Experiment 


Experiment 


Conceptual 


Survey 


Experiment 


Survey 


Survey 


Survey 


Experiment 


Mixed methods 


Conceptual 


Field study 


Experiment 


Sentiment 
analysis 


Experiment 


Survey 


Systematic review 


Survey 


= Ry WILEY 
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Key focus 


Anthropomorphism significantly increases the likelihood that users comply 
with a chatbot's request for service feedback. 


Explores the extent to which human-like cues (language style and name) and 
the framing used to introduce the chatbot can influence perceptions 
about social presence and anthropomorphism. 


Derive 12 preliminary meta-requirements and 4 preliminary design-principles 
when using virtual agents in customer service. 


Attributions of agency, emotionality, and morality to virtual agents contribute 
positively to the perceived humanness of the virtual agent, and perceived 
humanness was positively associated with customer satisfaction. 


The mere presence or absence of various linguistic elements (which should 
be seen as expressions of style rather than content) in text-based 
interactions can influence people's perceptions of virtual agent 
happiness. 


Perceived virtual agent effort is boosted when virtual agents engage in 
personal conversation, listening, and display of warmth vis-a-vis 
customers, and perceived virtual agents' effort is positively associated 
with customer satisfaction. 


Virtual agents provide interactive and engaging brand/customer service 
encounters. 


Interaction style and content of the online agent significantly influence the 
newcomer adjustment process over time, which in turn influences firm- 
level performance. 


When virtual agents initiate a conversation using a warm (vs. competent) 
message, brand engagement increases 


Findings show that while functional elements drive users' attitude toward 
using virtual agents, the social attributes, being social presence and social 
cognition, are the unique antecedents for developing trust. 


Distinguish four service encounter types and conceptually develops each 
encounter type. 


Outline an approach to detecting egregious conversations, using behavioral 
cues from the user, patterns in agent responses, and user-agent 
interaction. 


In a service encounter, entertainment, or playfulness, can influence the 
success of virtual agent-customer interactions. 


Overall sentiment towards virtual agents is less negative than sentiment 
towards online human agents; sentiments towards online human agents 
become more negative after a retailer implements a virtual agent. 


Lower interaction satisfaction with a virtual agent than with the human 
representative when anger is evoked. A virtual agent performed 
comparably to the human representative in terms of perceived usefulness 
and influence over participants’ compliance intention. 


Confirm the cross-channel applicability of friendliness and expertise as 
determinants of social presence and personalization. 


Utilitarian benefits are the most frequently reported factor influencing users' 
acceptance and willingness to use virtual agents. This is especially 
relevant in usage settings where the virtual agent aid users with their 
productivity, such as helping users to obtain timely information and 
efficient assistance. 


Intention to use virtual agents is directly influenced by the chatbots' 
expected performance. 


(Continues) 
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TABLE 1 (Continued) 

Research stream Authors Method 

Service failure Choi et al. (2020) Experiment 
Jones et al. (2022) Survey 
Huang and Dootson (2022) Survey 
Huang and Philp (2021) Experiment 
Lv et al. (2021) Experiment 
Shen and Wang (2022) Experiment 
This article Experiment 


2021). This study has contributed to an understanding of anthropo- 
morphic design cues, primarily for embodied virtual agents (i.e., those 
that have a virtual body or face) but also for disembodied virtual 
agents (i.e., through verbal cues; Araujo, 2018). From the customer 
perspective, anthropomorphism can make a virtual agent appear to 
be in an affective state. For example, a highly attentive service agent 
(human or virtual) is typically perceived as having a high degree of 
customer orientation (e.g., Brady & Cronin, 2001), or having the 
customer's interests front of mind (Deshpandé et al., 1993; Narver & 
Slater, 1990). 

A second stream of research concerns the consumer reactions to 
virtual agents in service encounters (i.e., Chung et al., 2020; Robinson 
et al., 2020; Sands et al., 2021; Verhagen et al., 2014). Like their 
human counterparts, virtual service agents can influence customer 
service evaluations and behavior (Cassell et al., 2000; Sands, Ferraro, 
et al., 2022; Sands, Campbell, Plangger, et al., 2022). For instance, 
interactions with virtual service agents can influence customer 
satisfaction when the interaction meets or exceeds expectations 
(Santini et al., 2018), subsequently influencing purchase intentions 
(Chung et al., 2020; Wiedmann et al., 2009). Within this stream of 
research, there is also a range of studies showing that customers 
perceive differences between humans and robots in terms of agency 
and experience (Bigman & Gray, 2018; Gray et al., 2007; Gray & 
Wegner, 2012; Pitardi and Marriott, 2021; Tran et al., 2021). Agency 
refers to the ability to think and act, whereas experience refers to the 
ability to feel emotions such as empathy (Gray & Wegner, 2012; Gray 
et al., 2007). Studies show that virtual entities are usually perceived 
as having low to medium agency and low level of experience, 
whereas humans tend to be perceived as having higher levels of both 
agency and experience (Gray & Wegner, 2012; Gray et al., 2007). 
Studies in this stream also consider the effect that virtual agent 


interactions have on customer emotion (Sandbank et al., 2017), which 


Key focus 


When involved in service failure, more “human-like” robots get more positive 
consumer reactions. 


Authenticity can be enhanced when the avatar is female, and these effects 
are amplified when the avatar is dressed professionally or of a different 
race than the consumer. 


Examine how customers respond to virtual agent service failure of a chatbot 
when there is an option to interact with a human employee. 


Demonstrate that consumers are less willing to share negative word-of- 
mouth after a service failure caused by an Al recommendation system, in 
contrast to a human employee 


Investigate effect of cuteness—in terms of voice and language—on customer 
tolerance of service failure. 


Examine the effects of service recovery (i.e., apology) on customer 
satisfaction. 


Investigate how customers respond to different types of service failure (small 
vs. large; outcome vs. process failure) resulting from an interaction with a 
virtual (human) service agent. 


is an important factor in consumption experience (Bagozzi et al., 
1999; Nyer, 1997; Soscia, 2007). From the perspective of appraisal 
theory, emotions are based on appraisals of customer experiences 
and may result in specific actions to affirm or cope with the emotion 
(Bagozzi et al., 1999). When experience falls below expectation, 
customers attribute blame to some other entity (Gelbrich, 2010; 
Rosenman, 1991), such as the firm or the service agent. In this case, 
negative emotions—including anger or frustration (Gelbrich, 2010)— 
may be directed toward the firm of the service agent. 

More recently, researchers have begun to investigate the way 
that consumers respond to service failure, when the failure is a result 
of the interaction with a virtual agent (i.e., Choi et al., 2020; Huang & 
Dootson, 2022; Jones et al., 2022; Shen & Wang, 2022). While there 
is a wealth of research into service failure and recovery, much of this 
study has been conducted in contexts of dyadic, customer-employee 
interactions (Huang & Philp, 2021). Relatively few studies have 
explored consumer reactions to virtual agents in service settings, 
although there is a large body of research on a contextually similar 
domain of self-service technology failures (c.f., Forbes, 2008) and 
service failure resulting from interactions with robots (c.f., Tung & Au, 
2018). Prior research on virtual agent service failures has considered 
how the presence of an employee can mitigate negative effects (Huang 
& Dootson, 2022), how virtual entities can engage in service recovery 
efforts (Shen & Wang, 2022), how design can be used to increase 
customer tolerance of service failure (Choi et al., 2020; Lv et al., 2021), 
and the impact of virtual agent service failure on consumer response 
(Huang & Philp, 2021). Much of this study has focused on consumer 
reactions to virtual agents when trying to resolve a service failure (i.e., 
interacting after the failure has occurred; Jones et al., 2022). However, 
little if anything is known about the way that consumers respond to a 
virtual agent when service misses the mark, or the reasons that these 


responses differ for different kinds of service failures. 
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2.2 | When service misses the mark 


Experiences that miss the mark and fall below a customer's 
expectations—or service failures—are inevitable. In the context of 
service interactions, failure often occurs because human interactions 
are susceptible to variation, unlike items produced by mechanical 
means (Berry & Parasuraman, et al., 1991; DeWitt & Brady, 2003). 
While service can fail following any customer-firm interaction, be it 
with humans or via digital or virtual environments (Choi et al., 2020; 
Lariviére et al., 2017), service failures vary in terms of the type of 
failure and its severity (Sands, Campbell, Ferraro, et al., 2022). Studies 
on service failures in the context of technology-infused service 
encounters usually focus on self-service contexts (e.g., Collier et al., 
2017), consumers' acceptance of, or responses to service robots (e.g., 
Mende et al., 2019; Wirtz et al., 2018) and, only recently, on service 
failures by robots (Choi et al., 2020). 


2.2.1 | Different types of service failure 

The various types of service failures can be grouped under several 
classifications, all of which tend to fall under the umbrella of negative 
events in marketing (Khamitov et al., 2020). One distinction is the 
outcome-process classification (Gronroos, 1988; Parasuraman et al., 
1991; Zhu et al., 2004). Process failures relate to the way the service 
is delivered and can be directly attributed to the behavior of service 
personnel. For instance, an agent treating customers rudely is an 
example of a process failure (Zhu, Sivakumar, and Parasuraman 
2004). On the other hand, an outcome failure is a core-service failure, 
or a failure in the delivered service itself. A store shipping the wrong 
product or an airline losing luggage are examples of outcome failures. 

Importantly, customers respond differently to outcome versus 
process failures (Roschk & Kaiser, 2013; Smith & Bolton, 2002; Zhu 
et al., 2004). These differences can be explained from a resource- 
exchange-theory perspective (Smith et al., 1999), whereby process 
failures pertain to problems that customers experience with symbolic 
exchanges, such as status, esteem, or empathy (Bagozzi, 1975). 
Outcome failures pertain to problems that customers experience 
with utilitarian exchanges involving economic resources, such as loss 
of money, goods, or time (Bagozzi, 1975). 

Given that customer appraisals of failure influence their 
responses (Tsarenko & Tojib, 2012), we expect differences in 
customer responses to be dependent on process or outcome failures, 
and on whether the interaction occurred with a human or a virtual 
service agent (Belanche et al., 2020). Given that virtual agents are 
generally perceived as having low agency and experience, we expect 
that a process failure—or symbolic exchange—is less likely to be 
attributed to a virtual agent. In contrast, it is anticipated that process 
failure will be attributed more to a human service agent given their 


high agency and experience. Specifically, we hypothesize: 


Hypothesis 1. Customers will react more negatively when experiencing a 


process failure following an interaction with a human service agent. 


eee WILEY 


We expect this effect to be different for outcome failures, given 
that these failures pertain to utilitarian exchanges, such as a loss on 
the customer's behalf. Prior research has shown that when consum- 
ers experience loss, they are more likely to attribute responsibility for 
negative outcomes to machines or robots (Lei & Rau, 2021; Moon, 


2003). Specifically, we hypothesize: 


Hypothesis 2. When experiencing an outcome failure, customers will 
react more negatively when experiencing an outcome failure following an 


interaction with a virtual service agent. 


2.2.2 | Magnitude of service failure 

Regarding the magnitude of service failure, researchers have 
demonstrated the effects of severity on customer responses (e.g., 
Gilly & Gelb, 1982; Hoffman et al., 1995; Richins, 1987). The 
magnitude of service failure can vary from small (e.g., frustrations or 
minor annoyances; Sands et al., 2020) to large (e.g., where customers 
experience significant loss; Tsarenko & Tojib, 2012). When the 
magnitude is perceived as large, the exchange relationship becomes 
unbalanced, leading to greater impressions of loss (Smith et al., 1999). 
In response, customers deploy various resources and strategies to 
readjust their position, managing or mitigating the negative effects of 
the encounter (Luce, 1998; McColl-Kennedy & Sparks, 2003). In the 
context of a larger service failure, we expect a greater—or more 
negative—effect. Prior research on customers' response to service 
failure suggests that the higher the magnitude of severity, the lower 
the resulting level of customer satisfaction (Hoffman et al., 1995; 
Richins, 1987). Further, research has shown that people tend to think 
of a robot as being less competent and reliable than a human (Lei & 
Rau, 2021). Past research finds that when two agents are potentially 
responsible for an outcome, the agent perceived as less competent 
tends to be blamed for failure (Beckman, 1970; Wetzel, 1982). 
Therefore, we expect customers’ reactions to being more negative 
when the magnitude of the service failure magnitude is greater and 
when the service encounter is with a virtual agent. Specifically, 


we hypothesize: 


Hypothesis 3. Larger service failures will have greater negative 
reactions, but these will be amplified when the failure following an 


interaction with a virtual service agent. 


3 | EXPERIMENTAL STUDIES 


In two experimental studies, we examine how customers respond to 
virtual agents when service fails. Experimental studies are particularly 
useful in our context given their ability to infer causal interpretations 
about group differences and to allow for a high degree of internal 
validity (Viglia & Dolnicar, 2020). In each experiment, we assess a 


different type of service failure (process failure, Study 1 vs. outcome 
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failure, Study 2), assessing both the consumer responses to the type 
of service agent (virtual vs. human agents) and the magnitude of the 
service failure (small vs. larger). In line with prior research, we focus 
on a range of customer outcomes following service failure (Bougie 
et al., 2003; Mathras et al., 2016; McColl-Kennedy et al., 2009; 
Strizhakova et al., 2012). With Study 1, we investigate effects on 
customer satisfaction, purchase intention, perceived customer 
orientation, and emotions. With Study 2, we build on these outcomes 
to include loyalty intentions, negative WOM, and blame attribution. 
In both studies, we test the boundaries of our results to determine 
the interactive effects between type of service agent and the 
different ways in which service can fail. Figure 1 presents our 
conceptual model, visualizing the manipulation of service agent type 
(treatment condition = virtual service agent; control condition = 
human service agent) and the magnitude of service failure (small vs. 
larger), across two different types of service failures: a process failure 
(Study 1) and an outcome failure (Study 2). 


4 | STUDY 1: PROCESS SERVICE FAILURE 


Study 1 investigates the effect of a process service failure on key 
customer outcomes, according to whether the service interaction is 
with a virtual or human service agent. We define a process service 
failure as inattentive service in line with prior conceptualizations and 
experimental scenario development (Smith et al., 1999). Specifically, 
we investigate how a virtual service agent (compared to a human) 
influences customer service evaluations following failure, in terms of 
customer satisfaction, purchase intention, perceived customer 
orientation, and negative emotions (H1). Further, we investigate 
how these effects vary according to the magnitude of the failure (H3). 

We present respondents with a hypothetical scenario in which a 
process service failure occurs. The process dimension of service 
failure involves the way that customers receive the service—or the 
way it is delivered (Gronroos, 1988), such as being treated rudely 
(Zhu et al., 2004) or receiving inattentive service (Smith et al., 1999). 
In our scenario, inattentive service is a small process failure (i.e., a 
service agent losing interest in the conversation), while being treated 
rudely is a larger process failure (i.e., a service agent being insulting). 
Within the context of this process service failure, we employ a 2 


(service agent: virtual vs. human) x 2 (service failure: small vs. larger) 


between-subjects experimental design. The service agent conditions 
are varied in terms of whether the failure resulted from an interaction 
with a virtual service agent (treatment group) or with a human service 
agent (control group), and the service failure conditions are varied in 
terms of being a small or larger magnitude failure. Respondents were 
randomly allocated to one of the four experimental conditions. The 
scenario was manipulated with a written description (see Appendix B 
for detailed scenarios). We engaged three experts to assist with the 
development of the scenarios and to ensure clarity, relevance, and 
realism, and conducted a pre-test to assess the magnitude of the 
service failure in the respective conditions. Minor modifications to 


phrasing were made to improve consistency and fluency. 


4.1 | Sample and measures 


The recruitment of online participants was carried out by Cloud 
Research to collect data from US respondents via an online survey. 
Three hundred and twenty respondents completed the survey; 
however, 19 (5.9%) were removed for failing instructed-response 
attention checks. Hence, the final sample comprised 301 respondents 
(female = 45.2%) with a mean age of 38 years (s.d. = 10.6). 

The measurement items for customer satisfaction, perceived 
customer orientation, negative emotion, and purchase intention were 
drawn from existing multi-item measurement scales in the literature. 
Customer satisfaction was adapted from a three-item scale 
(Westbrook & Richard, 1981), customer orientation was measured 
with a four-item scale adapted from Saxe and Weitz (1982), purchase 
intention was measured with a four-item scale adapted from Dodds 
et al. (1991), negative emotion was measured with a three-item scale 
adapted from Sands et al. (2021). All measurements used a 7-point 
Likert-type scale. Appendix A provides a list of multi-item variables 
and scale reliabilities. The internal reliability tests for the scales 
applied in Study 1 demonstrate strong Cronbach (1951) alphas 
ranging from 0.92 to 0.96. 


4.2 | Results 


Manipulation checks assessed the experimental manipulations. For 


service failure, respondents rated perceived inconvenience of the 


Service failure 
magnitude 
(Small vs large) 


Service agent 


Satisfaction, Purchase 
intention, Customer 
orientation, Negative emotion 


(Human vs virtual) 


FIGURE 1 Conceptual model 


(Study 1; Study 2); Loyalty, 
Negative WOM, Blame 
attribution (Study 2) 
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described scenario (on a 7-point Likert scale), with significant 
differences found in the expected direction (Mgmay = 2.10, 
s.d. = 1.31; Miarger= 2.57, s.d.=1.58; F(1, 299)=7.80, p=0.006, 
Cohen's d = -0.32). For agent type, respondents were asked if they 
recalled speaking with a human service agent or virtual service agent. 
Most respondents recalled the condition correctly (human agent = 
90%; virtual agent = 98%), with those that failed the manipulation 
check retained in the data set in line with the recommendations of 
Ejelév and Luke (2020). Respondents were also asked if the scenario 
was realistic (on a 7-point Likert scale) and no difference was 
identified between the virtual and human agent conditions (Myirtual = 
2.01, s.d. = 1.35; Mhuman = 1.84, s.d. = 1.42; F(1, 299) = 1.17, p = 0.28). 

Two-way analysis of variance (ANOVA) was conducted to test 
H1 and H2. The means and standard deviations across conditions for 
each outcome (satisfaction, customer orientation, and negative 
emotions) are presented in Table 2, and marginal means are plotted 
according to condition in Figure 2. 

For H1, we predicted that customers experiencing a process 
failure would react more negatively when the failure follows an 
interaction with a human (vs. virtual) service agent. Results reveal no 
main effects between human or virtual service agent for process 
service failure on satisfaction (F (1, 295) = 0.37, p = 0.54), customer 
orientation (F(1, 295)=0.25, p=0.62), purchase intention (F(1, 
295 =2.03, p=0.16), or negative emotion (F(1, 295) =0.26, 
p =0.61). These results show no difference by agent type for a small 
process outcome service failure; however, they do reveal significant 
interaction effects. Interaction effects show that when service is 
delivered by a virtual service agent and a larger magnitude 
process failure results, more negative satisfaction (F(1, 295) = 4.16, 
p=0.04, Cohen's d=0.29, partial n? =0.02), customer orientation 
(F(1, 295)=4.96, p=0.03, Cohen's d=0.35, partial n? = 0.03), and 
purchase intention (F(1, 295) = 6.88, p = 0.01, Cohen's d = 0.35, partial 


TABLE 2 Study 1 outcome variable means and standard 
deviations according to scenario condition 


Small process failure Large process failure 


M (S.D.) M (S.D.) 
Satisfaction 
Human agent 5.24 (1.28) 5.64 (1.00) 
Virtual agent 5.34 (1.28) 5.02 (1.31) 
Customer orientation 
Human agent 5.08 (1.25) 5.39 (0.91) 
Virtual agent 5.38 (1.18) 4.93 (1.32) 
Negative emotions 
Human agent 1.79 (1.03) 1.72 (1.26) 
Virtual agent 1.80 (1.38) 1.89 (1.16) 
Purchase intention 
Human agent 5.20 (1.40) 5.72 (1.04) 
Virtual agent 5.42 (1.17) 4.99 (1.33) 
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n? = 0.03) result. No interaction effect is found for negative emotions 
(F(1, 295) =0.21, p =0.65). Together, these results show that when 
experiencing a process failure, customers react in a similar manner 
regardless of whether the failure follows an interaction with a virtual 
or human agent (contrary to H1). However, when the magnitude of 
service failure is considered, more negative effects occur for larger 
magnitude failures following an interaction with a virtual agent 


(in support of H3). 


4.3 | Discussion 


We predicted that a process service failure would lead customers to 
react more negatively when the failure followed an interaction with a 
human service agent, compared to when the failure followed an 
interaction with a virtual service agent (H1). This was expected given 
that prior research has shown that virtual agents are typically 
perceived as having low agency and experience. Hence, we expected 
a process failure—or symbolic exchange—to be less likely to be 
attributed to a virtual agent. Conversely, process failures should be 
attributed more to human service agents given their high level of 
agency and experience. Our results reveal no main effects, suggesting 
that consumers respond in a similar pattern regardless of whether the 
failure was the result of a human or a virtual agent. However, we do 
find an interaction effect between service agent type and magnitude 
of service failure for satisfaction, purchase intention, and customer 
orientation. Specifically, when the failure is of a greater magnitude 
and follows an interaction with a virtual service agent, satisfaction is 
significantly less (and greater when the failure follows an interaction 
with a human agent). We find the same pattern for purchase 
intention and customer orientation, with both outcomes significantly 
lower when a larger magnitude failure follows an interaction with a 


virtual agent. 


5 | STUDY 2: OUTCOME SERVICE 
FAILURE 


Study 2 investigates the effect of an outcome service failure on key 
customer outcomes, depending on whether the service interaction is 
with a virtual or a human service agent. We define an outcome 
service failure as a failure in the delivered service itself resulting in a 
financial loss (Smith et al., 1999). Specifically, we investigate how a 
virtual service agent (compared to a human) affects customer service 
evaluations following failure (H2), and how these effects vary 
according to the magnitude of service failure (H3). This study 
extends Study 1 by including three additional outcome variables: 
loyalty, negative WOM, and blame attribution. Again, we employ a 2 
(service agent: virtual vs. human) x 2 (failure magnitude: small vs. 
larger) between-subjects experimental design. 

In this study, we present respondents with a hypothetical 
scenario demonstrating an outcome service failure. The outcome 


dimension of service failure involves failure in the delivered service 
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FIGURE 2 Process service failure (Study 1): Outcome variables, marginal means plotted according to condition 


itself, or a core-service failure. In our case, we choose a failure 
whereby a service agent failed to communicate the need to pay an 
additional, unknown, insurance premium to receive a replacement 
phone. Again, within the context of this outcome service failure, we 
employ a 2 (service agent: virtual vs. human) x 2 (service failure: small 
vs. larger) between-subjects experimental design. The service agent 
conditions varied in terms of whether the failure resulted from an 
interaction with a virtual service agent (treatment group) or a human 
service agent (control group), and the service failure conditions varied 
in terms of whether the failure was small or large in magnitude. The 
development of the scenario was similar to the process followed for 
Study 1, and each respondent was randomly allocated to one 


experimental condition (see Appendix B). 


5.1 | Sample and measures 

The same recruitment method was conducted via Cloud Research, 
with 240 US respondents completing the survey and 21 (8.7%) 
responses removed after data cleaning (i.e., for failing instructed- 
response attention checks). The final sample comprised 219 respon- 
dents (female = 46.3%) with a mean age of 36.5 years (s.d. = 10.9). 
The same measurement items as in Study 1 were employed with the 
addition of loyalty (measured on a three-item scale), negative WOM 
(measured on a single item), and blame attribution measured by 
allocating 100 “blame points” to either the agent or the firm. The list 


of scale items and internal reliability tests are presented in 


Appendix A and demonstrated strong Cronbach (1951) alphas for 
scales, ranging from 0.87 to 0.95. 


5.2 | Results 
Manipulation checks assessed the experimental manipulations. For 
service failure, respondents rated three manipulation check items on 
a 7-point differential scale. Significant differences were found for all 
items with the stem: in your opinion, the issue described in the 
scenario was: minor = 1, major = 7 (Msmau = 2-91, s.d. = 1.54; Marger = 
5.61, s.d. = 1.26; F(1, 217) = 201.88, p< 0.001, Cohen's d= 1.88), a 
small inconvenience=1, a major inconvenience =7 (Msmai = 3.18, 
s.d. = 1.69; Miarger = 5.98, s.d. = 1.26; F(1, 217) = 192.90, p < 0.001, 
Cohen's d= 1.81], caused a minor aggravation (1), caused a major 
aggravation (7) (Msmau = 3.41, s.d. = 1.81; Miarger = 5-91, s.d. = 1.42; F 
(1, 203)=129.53, p<0.001, Cohen's d=1.47). For agent type, 
respondents were asked if they recalled speaking with a human 
service agent or with virtual service agent. Respondents recalled the 
condition correctly (human agent=88%; virtual agent = 97%). 
Respondents perceived a high degree of realism for the 
scenarios, with no difference between the human or virtual agent 
manipulations (Myirtual = 5-79, s.d. = 1.38; Mhuman = 5.93, s.d. = 1.22; 
F(1, 217) = 0.67, p = 0.42). 

To test H2 and H3, a two-way ANOVA was conducted. This 
analysis tests the interaction effect of service agent (human and 


virtual) and service failure magnitude (small and larger) on the 
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TABLE 3 Study 2 outcome variable means and standard 
deviations according to scenario condition 


Small outcome failure Large outcome failure 


M (S.D.) M (S.D.) 
Satisfaction 
Human agent 3.16 (1.58) 1.60 (1.13) 
Virtual agent 3.15 (1.71) 2.36 (1.72) 
Customer orientation 
Human agent 3.96 (1.42) 3.14 (1.47) 
Virtual agent 3.90 (1.59) 3.28 (1.56) 
Negative emotions 
Human agent 4.14 (1.34) 5.80 (1.21) 
Virtual agent 4.19 (1.56) 4.98 (1.64) 
Purchase intention 
Human agent 3.14 (1.49) 1.60 (0.95) 
Virtual agent 3.14 (1.69) 2.21 (1.57) 
Loyalty 
Human agent 3.05 (1.41) 1.55 (1.03) 
Virtual agent 2.75 (1.60) 1.99 (1.57) 
Negative WOM 
Human agent 3.35 (1.54) 5.19 (1.65) 
Virtual agent 4.02 (1.67) 4.81 (1.48) 


Blame attribution - Agent 


Human agent 46.86 (31.35) 51.81 (44.97) 


Virtual agent 33.36 (33.89) 50.00 (39.25) 


Blame attribution-Firm 


Human agent 34.53 (30.89) 37.12 (31.56) 


Virtual agent 48.70 (39.28) 59.06 (39.31) 


Note: All items are based on a 7-point Likert scale, except blame 
attribution—agent and firm—which is based on 100 “blame points.” 


behavioral outcomes of satisfaction, customer orientation, negative 
emotion, purchase intention, loyalty, negative WOM, and blame 
attribution (blame agent and blame firm). Table 3 presents the 
marginal means according to condition for all behavioral outcomes, 
and Figure 3 shows all mean plots. 

Significant main effects are found for service agent type in terms 
of negative emotion (F(1, 205) = 3.71, p=0.06, Cohen's d= 0.35, 
partial n? = 0.02) and attributing blame to the firm (F(1, 205) = 13.32, 
p < 0.01, Cohen's d = -0.46, partial n? = 0.06). Significant main effects 
for service failure magnitude are found for satisfaction (F(1, 
205) = 34.24, p < 0.001, Cohen's d = 0.75, partial n? =0.15), customer 
orientation (F(1, 205)= 11.69, p< 0.001, Cohen's d= 0.82, partial 
n? = 0.06), negative emotions (F(1, 205) = 37.40, p < 0.001, Cohen's 
d=0.82, partial n?=0.16), purchase intention (F(1, 205)= 
47.19, p<0.001, Cohen's d=0.87, partial n?=0.19), loyalty 
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(F(1, 205) = 32.64, p < 0.001, Cohen's d = 0.82, partial n? = 0.14), and 
negative WOM (F(1, 205) = 34.99, p < 0.01, Cohen's d = -0.86, partial 
n? = 0.15). Significant two-way interactions are found for negative 
emotions (F(1, 205)=4.74, p=0.03, Cohen's d=0.29, partial 
n*=0.02), purchase intention (F(1, 205)=5.25, p=0.02, Cohen's 
d=0.29, partial n? = 0.02), loyalty (F(1, 205) = 3.55, p = 0.05, Cohen's 
d=0.20, partial n?=0.01), and negative WOM (F(1, 205) =5.56, 
p= 0.02, Cohen's d= 0.29, partial n? = 0.02). 


5.3 | Discussion 

In Study 2, we investigated the effect that an outcome failure had on 
customers. Outcome failure is defined as a situation whereby the 
customer experiences a loss resulting from an encounter with either a 
human or a virtual service agent. We predicted that customers would 
react more negatively when an outcome failure was the result of an 
interaction with a virtual service agent. However, we find significant 
two-way interactions between service agent and service failure such 
that more positive outcomes result when a larger magnitude outcome 
failure is the result of a virtual agent. Specifically, we find these 
positive effects for satisfaction, negative emotion, loyalty, and 
negative WOM-—with all variables rated more positively when a 


greater process failure is the result of a virtual service agent. 


6 | GENERAL DISCUSSION 


This article addresses an important question in today's increasingly 
digital customer service space—how do customers react to service 
failures that are the result of an interaction with a virtual service agent? 
By means of two studies, we investigate the effect of virtual agents' 
service failures. The first study focused on the effect of a process 
service failure and reveals interaction effects between service agent 
type and service failure magnitude. Specifically, for satisfaction, 
customer orientation, and purchase intention, we find differences 
between consumer responses to service failure following an interaction 
with a virtual or a human service agent. These effects occur after a small 
process service failure, but for a greater process service failure, 
differences between a human and a virtual service agent become more 
pronounced. Specifically, satisfaction, purchase intention, and customer 
orientation become more negative when a greater process failure 
follows an interaction with a virtual service agent. Results indicate that 
when a process failure results from an interaction with a virtual service 
agent, consumers derive less satisfaction, perceived customer orienta- 
tion, and purchase intention when the service failure is greater. In these 
settings, a human service agent would seem appropriate as they 
attenuate the negative effect of the process failure. 

From the perspective of resource-exchange-theory (Smith et al., 
1999), process failures pertain to symbolic exchanges—such as status, 
esteem, or empathy (Bagozzi, 1975). Our results suggest that process 
failures are better received by customers when they are the result of 


a human service interaction. Perhaps such symbolic exchanges are 
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FIGURE 3 Outcome service failure (Study 2): Outcome variables, marginal means plotted according to condition 


better manifest in human-human service encounters. Our second 
study investigated an outcome service failure, whereby a financial 
loss was experienced. In this context, we find that when a greater 
failure is the result of a virtual service agent, the negative effects can 
be attenuated—or buffered. We find this effect for satisfaction, 
negative emotion, loyalty, and negative WOM. Together, these 
results suggest that when experiencing a larger magnitude outcome 


failure, customers react more positively when the service agent is 


virtual. In such failure contexts, virtual service agents seem to act as 


buffers against the negative effects. 


6.1 | Theoretical contributions 


The increasing deployment of technology in service settings requires 


exploration to determine how customers interact with virtual agents 
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in general and when service fails. This study is timely given the 
increasing number of service robots in service settings and suggests 
that we make several important contributions. This study responds to 
calls to address technology-oriented service encounters (Lariviére 
et al., 2017; Rafaeli et al., 2017) and makes two overarching 
theoretical contributions. 

First, we contribute to the literature on virtual-human interac- 
tions by offering a better understanding of the way that consumers 
respond to embodied virtual agents, or agents that have a virtual 
body or face, and with which humans can have a physical interaction 
(i.e., Choi et al., 2020) to disembodied virtual agents (Araujo, 2018). 
Disembodied virtual agents cannot be seen directly by a customer 
but are increasingly being deployed for the delivery of customer 
service (Araujo, 2018). Prior research has shown that design 
elements, such as anthropomorphism (c.f., Epley et al., 2007), can 
have a positive impact on consumer responses. We find that in the 
case of virtual agents, despite not being physically present, the 
behavior of a virtual agent (i.e., how they fail) can influence consumer 
responses differently. 

Second, we contribute to the literature on virtual agent service 
failures and show that customer reactions are dependent on the 
nature of the failure; that is, whether it is a process failure or an 
outcome failure. Specifically, we find that when an outcome failure is 
the result of a virtual agent, the negative effects can be buffered. This 
result is contrary to our expectation that when consumers experience 
loss, they are more likely to attribute responsibility for negative 
outcomes to machines or robots (Lei & Rau, 2021; Moon, 2003). 
Further, we contribute to the vast body of literature on the 
magnitude of a service failure (Weun et al., 2004) and extend this 
to include the domain of virtual agent interactions. Prior research 
shows that as service failures grow in severity, negative affect also 
increases (Maxham & Netemeyer, 2002). We show that in the 
context of virtual service agent interactions, the increase in negative 
effects for larger service failures differs depending on the type of 
service failure. Specifically, outcome failures of larger magnitude at 
the hand of a virtual service agent have less negative impact on 
consumers. Together, these findings add to prior knowledge about 
buffering the negative effects of service failure, which has shown 
factors including the firm's reputation (Cranage & Sujan, 2004) and 
customer engagement (Sands, Campbell, Ferraro, et al., 2022) can 
buffer these effects. This understanding is important, given that the 
integration of virtual service agents into service channels is relatively 
new, and service failure resulting from interactions with these entities 


is almost inevitable. 


6.2 | Managerial implications 

From a managerial perspective, we provide insight into how firms 
might manage service interactions in different settings where there is 
the possibility of service failure—specifically, when the service 
interaction is facilitated by a virtual service agent. Not only does 


this increased knowledge of virtual service agents, but it also 
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facilitates organizational response to service failure. While past 
research shows that there can be a general aversion to virtual entities 
(Nomura, Kanda, et al., 2006; Nomura, Suzuki, et al., 2006), we show 
that firms can leverage virtual service agents to mitigate or buffer the 
negative effects of service failure. Our findings suggest that firms 
could consider engaging virtual service agents in situations where 
there may be a risk of outcome service failure—particularly in settings 
where relatively large magnitude failures may be experienced. In such 
a setting, we find that virtual service agents can act to mitigate the 
negative effects of service failure, more so than when a customer is 
served by a human. For brands that seek to engage virtual service 
agents, such a strategy can have a positive effect on customer 
evaluations of the failure. Ultimately, service blueprints should be 
employed to map the customer experience (Bitner et al., 2008) and 
determine where and when to deploy virtual service agents. When 
deploying virtual agents, firms generally do not explicitly disclose 
whether consumers are communicating with a human or chatbot, 
providing certain secondary cues that enable customers to infer this. 
However, we suggest that it can be beneficial for firms to be explicit 
and to make customers aware that they are communicating with a 


virtual agent. 


6.3 | Research limitations and future opportunities 
Our study has several limitations that provide opportunities for 
future research. First, while we find differences in effects that are 
dependent on the magnitude of service failure, our small and larger 
failures could be greater in terms of size. In terms of the process 
failure (Study 1), the small and larger conditions are both at the lower 
end of the spectrum, as measured on a 7-point scale. Despite this, the 
difference between conditions is significant and in the desired 
direction—which aligns with the desired experimental control that we 
seek in our experiment. In terms of the outcome failure, our larger 
service failure condition represents a financial loss of $500 to 
customers; however, more drastic failures may lead to quantitatively 
different results. It is important to acquire a better understanding of 
such differences, especially in contexts when service evaluations are 
more subjective. Segmentation studies that profile consumer 
responses to virtual agents in different contexts (Pallant et al., 
2022), may add value in this regard. 

Second, in this study, we do not examine service recovery 
processes. While there is an abundance of research on various forms 
of service recovery, including apologies, compensation, and speed 
(e.g., Hart et al., 1990; Kelley & Davis, 1994; Spreng et al., 1995), the 
role that virtual service agents can play in this process is unknown. 
Research into robot interactions address this question to some 
extent (Choi et al., 2020), but there is need for research to focus 
specifically on virtual service agents. Moreover, questions remain as 
to whether a virtual service agent can apologize. 

Third, our research is limited in that it does not investigate the 
effect of individual differences on responses to virtual service agents. 


Indeed, prior studies have shown that introverted consumers are 
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likely to spend more time alone, avoid interactions with large groups 


Saen 


of people, and enjoy solitary activities (Shumanov & Johnson, 2021), 
making these consumers more pre-disposed to use self-service 
technologies or to prefer virtual service agents rather than humans. 
Furthermore, prior research shows that human-computer interac- 
tions can be more personalized by matching consumer personality 
with congruent machine personality using specific language 
(Shumanov & Johnson, 2021). Hence, our results also fall short of 
determining the psychological mechanisms that drive the more 
positive effects of virtual service agents in the context of significant 
outcome failures. Further research should be conducted to investi- 
gate the potential moderators that explain our effects. 

Finally, our study does not consider the effects of agency and 
autonomy, which are important dimensions to consider and under- 
stand in the context of virtual agent service failures. While we cannot 
know if our respondents perceived any differences in agency or 
autonomy, we do find that failure attribution to the firm increases 
when failure follows an interaction with a virtual agent. This is in line 
with prior research showing that individuals blame computers for 
mistakes (Friedman, 1995). This is probably because humans treat 
virtual entities as social actors and consider them accountable for 
errors in at least some situations. Further research is warranted to 
understand agency and autonomy in the context of virtual agent 


service failure. 
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APPENDIX A 


VARIABLES AND SCALE RELIABILITIES 


Item Scale reliabilities 
Satisfaction 
| would truly enjoy this service interaction Study 1: a=0.96 


| would be satisfied with this service interaction 
The choice to interact with this service agent would be a good one Study 2: a=0.95 


Negative emotion 


Offended Study 1: a=0.87 
Disappointed 
Angry Study 2: a= 0.88 


Customer orientation (Study 1: a = 0.92; % variance explained = 75%; Study 2: 
a=0.91; % variance explained = 74%) 
The service agent would likely try to figure out what my needs were Study 1: a = 0.92 
The service agent would have my best interests in mind 
The service agent would likely take a problem-solving approach in selling 
products or services to me 
The service agent could recommend products or services that are best Study 2: a = 0.91 
suited to solving my problems 
The service agent would try to find out which kinds of products or services 
would be most helpful to me 


Purchase intention (Study 1: a = 0.96; % variance explained = 90%; Study 2: 
a=0.95; % variance explained = 91%) 

If | were going to purchase [a laptop (Study 1)/insurance (Study 2)], | would Study 1: a=0.96 
consider buying it at this brand 

If | were shopping for a [a laptop (Study 1)/insurance (Study 2)], the 
likelihood | would purchase from this brand is high 

My willingness to buy from this brand would be high if | were shopping for Study 2: a=0.95 
[a laptop (Study 1)/insurance (Study 2)] 


The probability | would consider buying from this brand is high 

Loyalty (Study 1: NA; Study 2: a= 0.93; % variance explained = 96%) 

The likelihood of me using this insurance agency in the future is... Study 1: N/A 
The likelihood of me recommending this insurance agency to friends is... 

The likelihood of me coming back to this insurance agency is... Study 2: a=0.93 


Note: All items measured on 7-point scales, anchored at 1 = totally disagree; 7 = totally agree, 
expect Loyalty which was anchored at 1 = very low; 7 = very high; Negative WOM measured with 
a single item; Blame Attribution measured with allocation of 100 “blame points” allocated 
between agent and firm. 
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APPENDIX B 


SCENARIO CONDITION MANIPULATION AND WRITTEN DESCRIPTIONS 


Manipulation Description 


Study 1: Process Service Failure 
Service agent (Human vs. You are having technical difficulties with your laptop and realize that you need a new 
virtual) one. There are several new models available, and you decide it is time to learn 
about the range of new laptops available and their features. At the online store, 
you can obtain product information via a live chat feature and are greeted by a 
[human/Vvirtual] service agent. [A virtual service agent utilizes artificial 
intelligence to simulate human behavior in customer interactions]. The agent 
welcomes you, “Hi, my name is Tony, how can | help you today?” The [human/ 
virtual] service agent offers to show you a range of products and features. 
Failure magnitude (Small After reviewing a range of laptops, you decide that you are going to buy one. 
vs. large) You have a few more questions to help you to identify which model you are 
going to buy. You ask Tony the [human/virtual] service agent to answer a 
few questions, but Tony is unable to provide any information that can help. In 
fact, [small failure: you get the feeling that Tony has lost interest in the 
conversation with you as you are being provided with nonspecific and 
generic responses that are of little use/large failure: In fact, you get the 
feeling that Tony is insulting your ability and knowledge regarding 
technology. Tony ends the conversation]. 


Study 2: Outcome Service Failure 
Service agent (Human vs. You have purchased a new smartphone for $1000 and want to get it insured. 
virtual) You start by searching the internet to compare several well-known insurance 
companies. Based on the online quotes you narrow the list down to a few 
companies, one of which is Global Direct Insurance. On the website you see 
that you can take out a new policy via a live chat feature, so you initiate the 
chat. You are connected to a [human/virtual] service agent. [A virtual 
service utilizes artificial intelligence to simulate human behavior in 
customer interactions]. The agent welcomes you, "Hi, this is Tony with 
Global Direct Insurance, how can | help you today?" 
You respond that you are looking to start an insurance policy for your new 

smartphone. “No problem, we have comprehensive plans and low prices,” the 
[human/Vvirtual] service agent proclaims. “If you would like to proceed, | can take 
details from you now to start your policy?” The [human/virtual] service agent 
guides you through the different types of coverage available and asks you some 
specific questions about your insurance needs. Once you are through asking 
questions, the [human/virtual] service agent advises that the basic insurance 
package includes theft, and there are several additional options that you might 
want to know about. You ask if you can include special coverage for loss and 
accidental damage of your new smartphone. The [human/virtual] service agent 
responds “Yes, we can include an option like that” and after some time notes “the 
loss and accidental damage options will result in a small increase in your 
premium.” You decide you want the extra insurance for your smartphone and ask 
the [human/virtual] service agent to add it to your new insurance coverage, 
including the loss and accidental damage cover. 

Failure magnitude (Small A week after you sign up for your insurance policy, you are out with some 

vs. large) friends and lose your new smartphone. You call the insurer to advise you lost 

your smartphone. The agent takes some details to fill out some forms, 
although stops and notes that original [human/virtual] service agent you 
spoke with failed to mention the [small failure: $25 deductible/large failure: 
$500 deductible] is required in addition to the extra premium that you had 
paid. This means that you will need to pay an additional [small failure: $25/ 
large failure: $500] to get a replacement phone. 


Note: Bold text represents variation in scenario conditions; text is compressed in table but presented across 
multiple pages within the survey. 
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